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SURVEYING SYSTEM 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

5 The present invention relates to a surveying 

system. In particular, it relates to a surveying 

instrument or system, including a total station, an 
electronic tacheometer, or the like, that is able to 
measure an angle and a distance relating to a measurement 
10 point. 

2 . Description of the Related Art 

Generally, a surveying operation requires at 
least two persons. Namely, one holds a target, such as a 
prism or the like, at a measurement point, while the 
15 other person operates a surveying instrument. In the 
surveying operation, in order to obtain measurement data 

for a plurality of measurement points, the person with 

i 

the target should move to each of the measurement points, 
and the other person should sight the surveying 

20 instrument to the target, each time the target moves to a 
measurement point. Therefore, the conventional surveying 
operation is quite cumbersome and requires at least two 
people and a lot of time, so it is inefficient and 
expensive. Recently, a non-prism- type surveying 

25 instrument, which requires no target, has been developed. 



1 



With the non-prism- type surveying instrument, the person 
who carries the target can be excluded and the surveying 
can be carried out by a single person who operates the 
surveying instrument, so that the efficiency of the 
surveying operation is improved. However, even when 
using the non-prism- type surveying instrument, the 
operator should still carry out sighting operations for 
each of the measurement points. This becomes extremely 
cumbersome and requires time particularly when the number 
of measurement points is large, such as when estimating 
the volume of a basin or hollow ground to be buried. 
SUMMARY OF THE INVENTION 

Therefore, an object of the present invention is 
to improve efficiency of the surveying operation. More 
particularly, the invention aims to cooperate measurement 
information obtained by a surveying instrument and image 

information of a surveying area which is obtained by a 

i 

camera, simply and efficiently, thereby improving 
efficiency. 

According to the present invention, a surveying 
system is provided. The system comprises a surveying 
device, a col linear-line calculating processor, a 
sighting direction control processor, and 'an object-point 
searching processor. 

The collinear-line calculating processor obtains 



a collinear line which provides a collinear condition for 
an arbitrarily designated point on a schematic image of 
which the positional relation to the surveying device is 
known. The sighting direction control processor controls 
5 the sighting direction of the surveying device to move 
along the collinear line. The object-point searching 
processor searches for an object point that can be 
determined as a point on the collinear line by measuring 
the sighting direction with the surveying device, while 
10 carrying out the sighting direction control procedure. 

Further, the position obtained by the object point 
searching processor coincides with an object point that 
corresponds to the designated point on the schematic 
image . 

15 Further according to the present invention, an 

automatic surveying system is provided that comprises a 
position relation calculating processor, a correspondence 
establishing processor, an input device, and a sighting 
direction control processor. 

20 The position relation calculating processor 

calculates a positional relation between a coordinate 
system to which measurement information of a measurement 
point refers and a schematic image of a surveying field, 
which includes the measurement point. The correspondence 

25 establishing processor establishes correspondence between 
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measurement information of the measurement point and 
position information of a point corresponding to the 
measurement point on the schematic image with respect to 
the above positional relation. The input device enables 
5 a designation of a measurement point on the schematic 
image. The sighting direction control processor controls 
a sighting direction of a surveying device in accordance 
with the position of the designated measurement point on 
the schematic image, which is designated by using the 
10 input device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present 
invention will be better understood from the following 
description, with reference to the accompanying drawings 
15 in which: 

Fig. 1 is a block diagram showing a general 
electrical construction of a surveying system for an 
embodiment of the present invention; 

Fig. 2 is a flowchart of the survey operation 
20 processes in the surveying system; 

Fig. 3 schematically illustrates an arrangement 
of the surveying instrument and the camera; 

Fig. 4 schematically illustrates the relations 
between the control points and the corresponding image 
25 points on the imaging surface S; 
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Fig. 5 is a flowchart of the space resection 
program that calculates exterior and inner orientation 
parameters ; 

Fig. 6 schematically illustrates an example of 
5 the schematic image indicated on the display; 

Fig. 7 schematically illustrates the principle of 
an automatic surveying operation in the present 
embodiment ; 

Fig. 8 is a flowchart of the automatic surveying 
10 operation in the present embodiment; 

Fig. 9 is a flowchart of an object point searching 
process which is carried out in Step S303 of Fig. 8; 

Fig. 10 schematically illustrates the relation 
between the sighting telescope of the surveying 
15 instrument and the surveying coordinates; 

Fig. 11 is a flowchart of the unit collinear 

vector calculating process; 

i 

Fig. 12 is a flowchart of the surveying operation 
for an alternate embodiment; and 
20 Fig. 13 is a flowchart of the surveying operation 

for an alternate embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is described below with 
reference to the embodiments shown in the drawings. 
25 Fig. 1 is a block diagram showing a general 
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electrical construction of an embodiment of the present 
invention, which includes a surveying instrument and a 
camera . 

A surveying instrument 10 of the present 
5 embodiment may be a total station or the like that 
comprises a sighting telescope 17. The sighting 

telescope 17 has a horizontal axis Lh for measuring an 
altitude Bp, and a vertical axis Lp for measuring a 
horizontal angle 6h . Namely, the sighting telescope 17 is 

10 vertically rotatable about the horizontal axis Lh and 
horizontally rotatable about the vertical axis Lp . The 
horizontal axis Lh and the vertical axis Lp intersect at 
point O s (referred to as the sighting origin O s in the 
following) at a right angle. The optical axis LN 0 (or 

15 collimation axis) of the sighting telescope 17 passes 
through the sighting origin O s - The optical axis LN 0 is 
bifurcated by a half -mirror 18, so that one of the 
bifurcated optical axes reaches the eyepiece lens and the 
other reaches the distance measurement component 11. 

20 The distance measurement component 11 detects an 

oblique distance to a measurement point (which is sighted) 
by using a phase modulation measurement method, a pulse 
radar method, or the like, while an angle 
measurement/control component 12 detects a vertical angle 

25 6p and a horizontal angle 0h . Further, the sighting 
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telescope 17 can be rotated about each of the horizontal 
and vertical axes Lh and Lp by using an actuator (not 
shown), such as a stepping motor. This motor driven 
rotation of the sighting telescope 17 is controlled by the 
5 angle measurement/control component 12 . 

The distance measurement component 11 and the 
angle measurement/control component 12 are connected to a 
system control circuit 13, whereby they are controlled by 
signals from the system control circuit 13. For example, 

10 the distance measurement component 11 detects a distance 
in accordance with signals from the system control 
circuit 13, and outputs the detected data or measurement 
data to the system control circuit 13. On the other 
hand, the angle measurement/control component 12 

15 continuously detects angles at a regular timing and 
outputs the detected data or measurement data to the 
system control circuit 13 when it is required. Further, 
the angle measurement/control component 12 controls the 
rotational movement of the sighting telescope 17 about 

20 the horizontal and vertical axes Lh and Lp by driving the 
stepping motor. The detected data, such as an oblique 
distance, horizontal angle, and vertical angle, are 
processed in the system control circuit 13. The system 
control circuit 13 is also connected to a switch group 

25 14, a display 15 (ex. LCD), an interface circuit 16, and 
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so on . 

A computer 40, such as a notebook sized personal 
computer, may be connected to the interface circuit 16 
through an interface cable. Namely, the surveying 

5 instrument 10 can transmit measurement data to the 
computer 40 via the interface cable. Further, the 

surveying instrument 10 can be controlled by control 
signals from the computer 40. For example, a sighting 
operation of the sighting telescope 17, to an arbitrary 

10 direction (horizontal angle 0h and vertical angle 0p) , 
may be controlled by the computer 40. Note that, the 
interface circuit 16 is also available for other 
peripheral devices, such as a data collector, and the 
like, which are not shown. 

15 The computer 40 is generally comprised of a CPU 

41, a recording medium 42, input devices including a mouse 
43 and a keyboard 44, a display (image indicating device) 
45, and an interface circuit 46. Examples of the 

recording medium 42 are a hard disk, DVD, MO, and IC card. 

20 Further, the display 45 includes an LCD, CRT, and so on. 

As described above, the interface circuit 4 6 is connected 
to the interface circuit 16 of the surveying instrument 10 
via the interface. Further, the interface circuit 46 can 
be connected to a digital still camera 20. Namely, an 

25 image captured by the digital still camera 20 is 
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transmitted to the computer 40 as digital image data and 
stored in the recording medium 42 via the interface 
circuit 46, for example. 

With reference to Fig. 1, Fig. 2, and Fig. 3, a 
5 single photograph orientation process in the . surveying 
system of the present embodiment will be described. Fig. 
2 is a flowchart of the single photograph orientation 
process in the surveying system of the present 
embodiment. Fig. 3 schematically illustrates an 

10 arrangement of the surveying instrument and the camera in 
the surveying system of the present embodiment. 

In Step 101, an operator takes a picture or image 
around the surveying area with the digital still camera 
(DSC) 20. Further, the obtained digital image data are 

15 transmitted to the computer 40 via the interface cable, 
and then stored in the recording medium 42. Note that, a 

plurality of measurement points, which are to be 

i 

measured, is included within the above captured digital 
image (referred to as a schematic image) taken by the 

20 digital still camera 20. 

In Step 102, the schematic image is indicated on 
the display 45 of the computer 40, for example. At this 
time a plurality of points (or pixels) on the schematic 
image are selected by the operator by using a pointing 

25 device such as a mouse 43. Thereby, substantial points 
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in the substantial or object space, which correspond to 
the selected pixels, are designated as control points P± 
(i = l, 2,...,n), where a control point is a measurement 
point that is arbitrarily selected for calculating the 
5 orientation of a schematic image. Further, the positions 
of image points Pi' that correspond to each of the 
control points P± are derived as two-dimensional image 
coordinates (xpi 1 ,ypi ! ) . Note that, the image coordinate 
system is a two-dimensional coordinate system of which 

10 the origin is at the upper left corner of the image with 
the y'-axis being positive in the downward direction. 
Further, the number "n" of control points which are three 
dimensionally arranged, may be more than 11. 

In Step S103, an oblique distance and the angles 

15 (such as vertical and horizontal angle) of each control 

point P±, which are appointed in Step S102, are measured 
by an operator by using the survey instrument 10. 
Measured values are then fed to the interface circuit 4 6 
of the computer 40 via the interface circuit 16. At the 

20 CPU 41, three-dimensional coordinates (Xpi , Yp± , Zp ± ) for 
each of the control points P ± are calculated in a 
predetermined surveying coordinate system. At this time, 
the correspondence between the surveying coordinates 
(Xpi , Ypi , Zpi) for each of the control points P± and the 

25 image coordinates (xpi 1 ,ypi ! ) for image points Pi' is 
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determined. Note that, the origin of the surveying 
coordinate system may be taken at the sighting origin O s 
of" the surveying instrument 10, and the absolute 
coordinates, including latitude and longitude or any type 
5 of positioning format defined by the relevant surveying 
authority, may be adapted to the above survey 
coordinates. Further, the surveying coordinates 

calculation may be carried out in the surveying 
instrument 10, and later the calculated data may be sent 

10 to the computer 40. 

As will be explained in detail later, exterior 
orientation parameters for the digital still camera 20, 
which represent the position and the inclination of the 
camera 20 at the moment when the schematic image was 

15 taken, are calculated in Step S104 , in accordance with 
the correspondence between the surveying coordinates and 
the image coordinates for each of the control points P± , 

i 

by means of space resection. Further, inner orientation 
parameters for compensating for aberrations from the 

20 collinear condition due to lens distortion or 
displacement of the principal point from the image 
center, may be calculated. Namely, the position or the 
surveying coordinates (X 0 ,Yo,Z 0 ) of the origin O c of the 
three-dimensional camera coordinate system, which is 

25 fixed in the digital still camera 20, and the rotational 
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angle (©,()), k) about the x-axis, y-axis, and z-axis of the 
camera coordinate system, at the time, are derived as 
exterior orientation parameters. Further, the inner 

orientation parameters (f : distance from the center of 
5 projection for the lens or the principal distance; 
D 2 ,D 4 ,D 6 : second, fourth, and sixth order components of 
the distortion; Ni,N 2 : unsymmetrical components of 
distortion; X C ,Y C : displacement of the principal point from 
the center of the image) are obtained. Thereby, the 

10 perspective projection relationship between the image 
coordinates and the surveying coordinates is established. 
Note that, when the inner orientation parameters are 
definite for the above ( f , D 2 , D 4 , D 6 , N x , N 2 , X c , Y c ) , the number 
of control points required for calculating the exterior 

15 and inner orientation parameters is at least seven. 

Among these control points, at least three are required 
to calculate the exterior orientation parameters 
(X 0 , Y 0 , Z 0 , co , (j> , k) . Note that, in the present embodiment, 
eleven (or more) control points are required to calculate 

20 the exterior and inner orientations . 

Note that, the camera coordinate system is a 
left-handed coordinate system of which the origin O c is 
located at the center of the lens or the center of the 
projection, and in which the y-axis and z-axis are 

25 parallel to each of the s'-axis and t '-axis of the screen 
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coordinate system. Further, the x-axis of the camera 
coordinate system is normal to the imaging surface and is 
oriented to the side opposite to the imaging surface from 
the center of the projection. Namely, any point on the 
5 imaging surface is represented by the camera coordinates 

(-f,y,z). Here, the screen coordinate system is a two- 
dimensional coordinate system of which the origin is 
defined at the principal point with each of the s'-axis 
and t'-axis arranged in parallel with each of the x'-axis 
10 and y'-axis, that is, in parallel with each of the 
horizontal and vertical lines of the imaging device 21 

(see Fig . 4 ) . 

As described above, the single photograph 
orientation process of the present embodiment ends. Note 
15 that, the image capturing operation in Step S101 can be 
excluded and an image taken previously may be used as a 

schematic image, in place. Further, although the single 

i 

photograph orientation process in the present embodiment 
is described with reference to the flowchart of Fig. 2, 

20 Step S103 may be carried out prior to Steps S101 and 
S102. Furthermore, previously measured or given 

measurement data, including the data for the 
triangulation control point, any type of map data, or 
geographical data, may be used as measurement information 

25 for control points. 
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With reference to Fig. 4 and Fig. 5, a principle 
for obtaining the exterior orientation parameters 
(position and the inclination) and the inner orientation 
parameters of the digital still camera 20, by space 
5 resection (Step S104), will be explained. 

Fig. 4 schematically illustrates the relations 
between the three control points P x , P 2 , and P 3 , and the 
corresponding image points Pi 1 , P2 f , and P 3 ' on the 
imaging surface S. Fig. 5 is a flowchart of the space 

10 resection program that calculates exterior orientation 
parameters (X 0 , Yo , Z 0 , <Q , <J> , k) , which represent the position 
and the inclination of the digital still camera 20, and 
inner orientation parameters (f , D 2 , D 4 , D 6 , N a , N 2 , X c , X c ) which 
depend on the optical system of the camera 20. For the 

15 space resection calculation, a least square method 
including a successive approximation solution is applied. 

Note that, although it is acceptable for the number of 

1 

control points to be seven or more, here, a case when 
eleven points are designated for the control points, is 
20 explained, as an example. However, for convenience, only 
three control points Pi, P 2 , and P 3 are illustrated in 
Fig . 4 . 

In Step 201, appropriate initial values 

(Xqo , Y G o , Zqo , G>g , §g 1 Kg) and ( f g , D 2 g , D4G , I^6g , Nig , N 2 g , Xcg / Ycg) are 
25 given as approximate values for the exterior orientation 
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15 



20 



parameters (X Q , Y 0 , Z 0 / G> / $ , k) , representing the position 
and the inclination of the camera, and the inner 
orientation parameters (f ,D 2 ,D 4 ,D 6 ,Ni ,N 2 ,X C , Y c ) . Then in 
Step S202, approximate image coordinates (xp Gi ■ , YPgi t ) of 
the image point P± f ( i = l , 2 , ... , 1 1 ) , which correspond to 
each of the eleven control points Pi, are calculated from 
the surveying coordinates (Xp ± , Yp t , Zp± ) of the respective 
control points P± , by using the given exterior 
orientation parameters (X G0 , Y G0 , Z GO , g>g , <|>g / k g ) and inner 
orientation parameters (f G , D 2G , D 4G , D 6G , N iG , N 2G , X CG , Y CG ) - 

Namely, the coordinates (xp ± ,ypi , zpi) of the 
control points Pi (i=l,2,3) in the camera coordinate 
system are derived from coordinates (Xpi , Ypi , Zp ± ) of the 
surveying coordinate system by Eq. (1), thereby, 
approximate camera coordinates (xp Gi , yp Gi , zp Gi ) of the 
control points Pi are obtained by substituting the 
approximate exterior orientation parameters 

(X GO , Y GO , Z GO , <o G , <|> G , k g ) and the surveying coordinates 
(xpi ,ypi , zpi) of the control points Pi into Eq. (1). 



yPi 

K z PtJ 



v 



^21 ^22 ^23 
^31 ^32 ^33 J 



(1) 
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YPi-Yo 
Z Pi ~ z o J 

where {T 3k } represents a rotational matrix, and each of 
the elements Tjk are described in the following forms . 
T n = COS^ COS/C 
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T l2 = cos co - sin k + sin co • sin ^ • cos a: 
7j 3 = sin • sin k - cos co • sin ^ • cos a: 
r 21 = -cos^-sin/c 

7 22 = cos co - cos a: - sin co • sin <f> • sin a: 
5 7 23 = sin 6; • cos k + cos • sin <f> • sin a: 

r 31 = sin^ 
r 32 = -sin<i>cos^ 
T 33 = cos co • cos ^ 

The screen coordinates (spi f ,tpi f ) of the image 
10 point Pi' corresponding to the control points Pi, which 
have not being yet been compensated by the inner 
orientation parameters, are derived from the collinear 
condition (wherein a control point, the center of 
projection, and the corresponding image point are aligned 
15 on the same line) . Therefore, the uncompensated screen 
coordinates <spi f ,tpi f ) are calculated by substituting the 
exterior orientation parameters (X 0 , Y 0 , Z 0 , co , (|> , k) and the 
camera coordinates (xpi , yp ± , zpi) of control points Pi into 
the following Eq. (2) „ 

Pi 7 x Pi 7 T^Xn-X^ + T^Ypt-YJ + T^Zpt-Zn) 

a,, = f *Pi = f T 3l (Xp t -X 0 ) + T 32 (Yp i -Y 0 ) + T 33 ^ i -Z 0 ) (2) 
Pi 7 x Pi 7 T u (Xp t -X 0 ) + T„(Y Pl -Y n ) + T„(& t -Z 0 ) 

Although, the uncompensated screen coordinates 
25 (spi^tpi') are affected by distortion, the effect is 
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compensated for by substituting the screen coordinates 
(spi^tpi 1 ) of each image point Pi f and the approximate 
inner orientation parameters ( f G , D 2G f D 4G , D 6G / N iG , N 2G / X CG / Y CG ) 
into the following Eq. (3) . Namely, compensated 

5 approximate screen coordinates ( scp G ± ' , tcp G ± T ) are 
obtained . 

R 2 =sp i t2 +tp i ' 2 

scp; = sp/(l^D 2 R 2 -hiy? 4 +D 6 R 6 ) + (R 2 +2sp i ' 2 )N l +2sp;tp.'N 2 +X C (3) 
tcp; = t P ; (1 +D 2 R 2 + D 4 R 4 + D 6 i? 6 ) + IspWNi+iR 2 + 2Jp, a )N 2 +r c 
10 Further, approximate image coordinates (xp Gi ' / ypci 1 ) 

of the image points Pi 1 can be derived by substituting 
the compensated approximate screen coordinates 
(scp Gi ' , tcp Gi ' ) into the following Eq. (4). 

xp i '=scp i '/(-Px) + W/2 
is y Pi '=tc Pi '/Py + H/2 (4) 

where Px and Py are the pixel pitches of the CCD or the 
image in the horizontal and vertical directions 

i 

respectively, and W and H are the numbers of pixels in the 
CCD or the image, which are aligned in the horizontal and 

20 vertical directions, respectively. 

In Step S203, a merit function <E> is calculated in 
order to determine whether the approximately given 
exterior orientation parameters (X GO , Y G0 , Z GO , © G , <|> G , k g ) and 
inner orientation parameters (f G ,D 2G/ D4 G /D 6 G, N iG , N 2G , X CG , Y CG ) 

25 are appropriate. For example, the merit function <S> is 
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determined by the following Eq, (5) . 

<*> = Z W-W) 2 +(yp i '-yp Gi ') 2 } ( 5) 

1=1 

Namely, in the present embodiment, the merit 
function <I> corresponds to the total amount of squared 
5 distances between the image coordinates (xpi T ,ypi f ) of 
image points P± J corresponding to the control points P± 
(which are selected in the schematic image) , and the 
approximate image coordinates (xp Gi ' , yp G ± T ) of the image 
points Pi' calculated from the surveying coordinates 

10 (Xpi , Ypi , Zpi) of the control points P ± , the approximately 
given exterior orientation parameters 

(X GO , Y GO/ Z G o,g>g/<|>g/Kg) and inner orientation parameters 
( f g , D 2G , D 4G , D 6G , Ni G , N 2G , X CG / Y C g) • 

Then, whether the merit function is smaller than 

15 a predetermined value is determined, in Step S204 . That 
is, whether the approximate image coordinates 
(xpGi 1 , yp G i f ) of the image points Pi 1 , which are obtained 
from the approximately given exterior orientation 
parameters (X G o , Y G o / Z G o , © G , (J> G , k g ) and inner orientation 

20 parameters ( f G , D 2 g / D 4G , D 6G , N iG , N 2 g / X C g / Y CG ) / are sufficiently 
close to the image coordinates (xpi f ,YPi f ) of the image 
points Pi 1 corresponding to the control points P± , which 
are designated on the schematic image, is determined. 
When the value 0 is smaller than the predetermined 
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value, this process is terminated and the values of the 
presently given exterior orientation parameters 
(X GO , Y go , Z go ,(0 g , (()g,Kg) and inner orientation parameters 
(fG/D2G/D 4 G/D6G/NiG,N 2 G/XcG, Y C g) are determined as the 
5 exterior and inner orientation parameters that represent 
the exterior orientation parameters (which indicate 
position and the inclination of the camera) and inner 
orientation parameters when the schematic image was 
captured . 

10 On the other hand, when the value of <I> is 

determined to be larger or equal to the predetermined 
value, in Step S204 , then in step S205, compensation 
values (5X,5Y , 5z ,5© ,5<J>,5K,Sf ,5d 2 ,5d 4 , 5d 6 ,5Ni ,5N 2 ,5X c ,6y c ) for 
the approximately given exterior orientation parameters 

15 (X GO , Y G o,Z G o/G>G,<j>G,K G ) and inner orientation parameters 

(f g,D2g/D4G/D 6 g,Nig,N 2 g,Xcg/ Ycg) are calculated by using the 

least squares method, for example. Namely, ( scpi ' , tcpi 1 ) 

i 

of Eq. (3) are substituted for (spi',tpi f ) of Eq. (2), 
which represents the collinearity condition. Eq. (2) is 

20 then subjected to Taylor's expansion at the approximate 
exterior orientation parameters (X G o , Y G o / Z G o / cDg / <|>g , k g ) and 
inner orientation parameters (f G , D 2 g , D4G , D 6 g f Nig / N 2 g/ X C g / Y C g) 
and the higher order terms are neglected so as to 
linearize the formula. Accordingly, the normal 

25 equations, for which the compensation values 
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<SX,8Y,8z,8© ,8<|>,Sk) and (Sf , 8D 2 , 8D 4 , 5D 6 , 5Nx , 8N 2 , 5x c , 5Y C ) are 
regarded as unknown values, are derived in order to 
obtain the appropriate compensation values 

<5X , SY , 5Z , 8© , 5(|> , 5k) and (8f , SD 2 , 5D 4 , Sd 6 , 5N a , 5N 2 , 5x c , 5Y C ) . 
5 In Step S206, the approximate exterior 

orientation parameters (X G o / Y GO , Z GO r ©g , $g r Kg) and inner 
orientation parameters (f G ,D 2G/ D4 G ,D 6G , Ni G , N 2G , X CG / Y CG ) are 
altered by the compensation values (5X , 5Y , 5Z , 5© , 5<() , 6k) and 
(5f ,802,804 , 5D 6 ,5N! ,8n 2/ 5x C/ 5Y c ) which are obtained in Step 

10 S205. That is, each of the values (X GO , Y GO , Z GO , ©g , 4>g / k g) 
and (f , G ,D 2G ,D 4G ,D 6G ,Ni G/ N 2G ,X CG ,Yc G ) is replaced by the 
values (X GO +8x , Y GO +SY , Z GO +5Z , © G +S© , (|) G +8<]) , k g +8k) and 

{ f G +6f , D 2G +8D 2 , D 4G +SD 4 , D 6g +8D 6 , Nig+SNx , N 2G +SN 2 , X C g+5X c , Y C g+5Y c ) 
to thereby renew or compensate the position, inclination, 

15 and inner orientation parameters of the camera. Then the 
process returns to Step S202, so that Steps S202 through 
S206 are repeated until the value <J> is determined to be 
smaller than the predetermined value in Step S204 . 

With reference to Fig. 1, Fig. 6, and Fig. 7, the 

20 automatic surveying operation using the surveying system 
of the present embodiment will be explained. 

Fig. 6 schematically illustrates an example of 
the schematic image indicated on the display 45. An 
operator operates the mouse 43 and controls a mouse 

25 cursor on the schematic image in order to define an area 

20 



(a surveying area) "A" that is to be surveyed. The 
computer 40 obtains a collinear line LN C that satisfies 
the collinear condition of" an arbitrary pixel within the 
surveying area "A" (e.g. the image point Q 6 1 
5 corresponding to an object point Q 6 ) / as shown in Fig. 7. 
The surveying instrument 10 scans along the collinear 
line LN C (which is carried out by moving the collimation 
axis LN 0 of the surveying instrument along the collinear 
line LN C under the condition that the collimation axis 

10 LN 0 intersects the collinear line LN C ) and obtains 
measurement data at a predetermined interval (e.g. points 
Rx-R 5 ) in accordance with signals from the computer 40, 
so that the object point Q 6 is searched with reference to 
the measurement coordinate values obtained when sighting 

15 the surveying instrument 10 to each of the points Rj 
( j=l , 2 , ... , 6) - This operation may be carried out for all 

pixels within the surveying area "A", Further, the 

i 

surveying area "A" may be automatically divided into 
arbitrarily distanced grids (e.g. regular intervals) and 

20 the scanning operation may be carried out only for each 
of the nodal points on the grids. Further, a curvature 
line "B " (or a segment) can also be defined and they may 
be automatically divided into arbitrary intervals (e.g. 
regular intervals) . In the present embodiment, both a 

25 surveying area "A" and a curvature line "B" are 
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determined by an operator. An area or a line may also be 
divided with respect to regular angular intervals for a 
surveying instrument . Further , a surveying area "A" and 
a curvature line "B" can be defined automatically by an 
5 image processing executed on the schematic image. For 
example, -an area and line may be detected with respect to 
an arbitrary color or luminance, or by using an edge 
enhancing process . 

When the surveying instrument 10 is sighted to 

10 the point R 2 on the collinear line LN C , a position which 
is measured is the object point Q 2 which is outside the 
surveying area "A" . The image coordinates (x q2 f ,yq 2 f ) on 
the schematic image, which corresponds to the object 
point Q 2 , is calculated by substituting the exterior 

15 orientation parameters (X G , Y 0 , Z 0 , CD , (|) , k) and the inner 
orientation parameters ( f , D 2 , D 4 , D 6 , N x , N 2 , X c , X c ) of which 

the values are obtained by the single photograph 

i 

orientation process, and the surveying coordinates 
(Xq 2 , Yq 2 , Zq 2 ) of the object point Q 2 , into Eq. (1) through 

20 Eq. (4). However, the image coordinates (x^^y^ 1 ) which 
correspond to the measured object point Q 2 are different 
from the image coordinates (x q6 ',Yq6 T ) of the designated 
image point Q 6 1 since the object point Q 2 is not equal to 
the object point Q 6 which corresponds to the designated 

25 image point Q 6 f . 
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On the other hand, the point R 6 on the collinear 
line LN C coincides with the object point Q 6 where the 
collinear line LN C intersects with a subject within the 
surveying area "A". Namely, image coordinates calculated 
5 from surveying coordinates that are obtained when the 
surveying instrument 10 is sighted to the point Re , 
coincide with the image coordinates (Xqe^yqs 1 ) of the 
designated image point Q 6 r . Consequently, automatic 
measurement for an object point that corresponds to an 

10 arbitrarily designated pixel on the schematic image can 
be achieved by carrying out surveying along a collinear 
line corresponding to the arbitrarily designated pixel (a 
pixel within the surveying area "A" in the present 
embodiment) , and searching for an object point of which 

15 the image coordinates obtained from its surveying 
coordinates substantially coincide with the image 

coordinates of the arbitrarily designated pixel. 

i 

With reference to Fig. 8 to Fig. 11, the 
automatic surveying operation of the present embodiment 
20 will be explained in detail . 

Fig. 8 is a flowchart of the automatic surveying 
operation program. The program is executed in the CPU 
41. The automatic surveying operation of Fig. 8 is 
carried out after the completion of the single photograph 
25 orientation process for the schematic image. Therefore, 
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the exterior and inner orientation parameters for the 
digital still camera 20, when the schematic image was 
taken, have already been obtained. In Step S301, the 
surveying area "A", which is defined by an operator on 
5 the schematic image on the monitor 45 by using the mouse 
43, is received. Further, all pixels within the 

surveying area "A" are numbered (1 to N, where "N" is the 
total number of pixels inside the surveying area "A") . 

In Step S302, "1" is set for a pixel number "i", 

10 so that Step S303 through Step S306 are repeated until 
"i" reaches "N" . In Step S303, surveying along the 
collinear line that corresponds to the image coordinates 
(Xi f ,yi ? ) of a pixel number "i" is automatically carried 
out. Namely, the position of an object point that 

15 corresponds to the pixel with the pixel number "i" is 
searched and measured by comparison between the image 
coordinates corresponding to measured surveying 
coordinates and the image coordinates (Xi^yi 1 ) of the 
pixel with the pixel number "i" (object point searching 

20 process) . Note that, the detail of the object point 
searching process will be explained latter. 

In Step S304 , the measurement data of the image 
coordinates (Xi'/Yi') obtained by the object point 
searching process of Step S303 is recorded in the 

25 recording medium 42. In Step S305, whether the pixel 
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number "i" is larger than the total pixel number "N" is 
determined. Namely, whether the object point searching 
process has been carried out for all pixels inside the 
surveying area "A" is determined. When it is determined 
5 that it has not, i.e. i=N, the number "i" is incremented 
by one in Step S306 and the process returns to Step S303. 
On the other hand, when it is determined that i=N, this 
automatic surveying operation ends. 

Fig. 9 is a flowchart of the object point 
10 searching process that is executed in Step S303. In Step 

5401, a unit collinear vector ( r lx , r iy , r iz ) for the 
collinear line LN C of the image coordinates (xi 1 ,yi' ) is 
calculated (unit collinear vector calculating process) . 
In the object point searching process, the surveying is 

15 carried out by sighting the surveying instrument 10 to 
hypothetical sighting points Rj which are arranged on the 
collinear line LN C at predetermined intervals. In Step 

5402, the distance "L" from the origin O c (X 0 ,Y 0 ,Z 0 ) of 
the camera coordinate system to a hypothetical sighting 

20 points Rj on the collinear line LN C is set to the initial 
distance L a . 

In Step S403, the surveying coordinates 
(X Rj , Y R j , Z R j ) of the hypothetical sighting points Rj are 
calculated from the unit collinear vector (r ix , r iy , r iz ) , 
25 which is obtained in Step S401, and the distance ff L", as 
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follows . 



X R j=X 0 +r ix xL 

Y Rj =Y 0 +r iy xL (6) 
Z R 3 = Z 0 +r i2 xL 

Further, the horizontal angle 0h and the altitude 9p for 
sighing the sighting telescope 17 to the hypothetical 
sighting point Rj are obtained by Eq. (7) and Eq. (8) . 
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Note that, as described in Fig. 10, the origin of the 
surveying coordinates system is positioned at the 
sighting origin OS in Eq. (7) and Eq. (8). When Gp=9h , 
the X-axis coincides with the horizontal axis Lh , the Y- 
15 axis coincides with the vertical axis Lp, and the Z-axis 
coincides with the collimation axis (optical axis) LN 0 . 
Further, at this time, the surveying instrument 10 



6p- sin 
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orients the collimation axis (optical axis) LN 0 of the 
sighting telescope 17 to (Gh, 0p) in accordance with 
signals from the computer 40. 

In Step S404 , the measurement or surveying is 
5 carried out for the direction which is sighted in Step 
S4 03. According to the above measurement, the surveying 
coordinates (X Qi , Y Qi , Z Qi ) for the object point Qi is 
calculated from the substantial measurement data for the 
object point Q± which corresponds to the hypothetical 

10 sighting point Ri . The image coordinates Ix-qi* ,yQi' ) 

which correspond to the surveying coordinates 
(X Qi , Y Qi , Z Qi ) of the object point Q± are then calculated 
from the exterior orientation parameters (X 0 , Y 0 , Z 0 / Q> , (|> , k) 
and the inner orientation parameters 

15 (f ,D 2/ D 4 ,D 6/ N! ,N 2/ X c ,Xc) , in Step S405. 

In Step S406, whether the image coordinates 

( x qi 1 r Yqi 1 ) of the object point Qi coincide with the image 

i 

coordinates (Xi^yi 1 ) of the collinear line LN C is 
determined. For example, when the distance between the 

20 image coordinates (x Qi ' ,yQi f ) and the image coordinates 
(x± f /Yi') is within a predetermined value, it is 
determined that the coordinates (x Q i',YQi f ) of the object 
point Qi coincide with the image coordinates (Xi^Yi') of 
the collinear line LN C . In this situation, the surveying 

25 coordinates (X Qi , Y Qi , Z Qi ) of the object point Q A , which are 
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calculated in Step S407, are defined as the surveying 
coordinates of the pixel (Xi f ,yi f ) that corresponds to 
the pixel number "i". Accordingly, the object point 
searching process for the pixel number "i" ends. On the 
5 other hand, when it is determined that the above two sets 
of coordinates do not coincide, the distance "L" is 
replaced by "L+AL" in Step S408, and the processes from 
Step S403 are repeated. Note that, "AL" is an increment 
for the distance "L" and defined by regarding the 

10 required precision and the surveying time. 

Next, with reference to Fig. 11, the unit 
collinear vector calculating process that is carried out 
in Step S401 is explained. Fig. 11 is a flowchart of the 
unit collinear vector calculating process. 

15 In the present embodiment, a unit collinear 

vector is calculated by means of the least square method. 
Namely, in the unit collinear vector calculating process 
of the present embodiment, an arbitrary unit vector 
(r G i X / **Giy / r G iz) is given as an approximate unit collinear 

20 vector for a pixel (Xi T ,yi f )/ in the first step. 
Therefore in Step S501, the image coordinates (x G i f ,yGi') 
for the surveying coordinates (X 0 +r Gix , Y 0 + r Giy , Z 0 +r G iz ) that 
correspond to the end of the unit vector ( r Gix , r Giy , r Giz ) 
which extends from the origin O c : (X 0 , Y 0 , Z 0 ) of the camera 

25 coordinates system, are calculated using Eq. (1) to Eq. 
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(4) with respect to the exterior orientation parameters 
(Xo r Yo / Zo/©/<J)/K) and the inner orientation parameters 
(f ,D 2 ,D 4 ,De,Xi, N 2 ,X c ,Xc> . 

In Step S502, a merit function *F= (Xi ' -x Gi ' ) 2 + (y± ' - 
5 Ygi ? ) 2 is calculated for the image coordinates (x G j. 1 ,y Gi ' ) 
obtained in Step S501 . Whether the merit function *F is 
smaller than a predetermined value is determined in Step 
S503. When it is determined that the merit function ¥ 
is smaller than the predetermined value, the unit vector 
10 (r Gix , r G iy , r G iz) is defined as the unit collinear vector 
(r ix , r iy , r iz ) of the pixel that corresponds to the pixel 
number "i", in Step S504 , so that this unit collinear 
vector calculating process for the pixel number T, i" ends. 

On the other hand, when it is determined in Step 
15 S503 that the merit function ¥ is not smaller than the 
predetermined value, compensation values (5r ix , 5r iy , 5r iz ) 
for the approximate unit vector (r Gix , r Giy , r Giz ) are 
calculated by means of the least square method, in Step 
S505 . Further, the approximate unit vector is replaced 
20 by a new unit vector (r Gix + 5r ix , r Giy +5r iy , r Giz +5r iz ) . The 
process then returns to Step S501, so that Step S501 to 
Step S505 are repeated until the merit function *F is 
determined to be smaller than the predetermined value, in 
Step S503. 

25 Note that, the volume of the surveying area is 
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calculated from the measurement data of the surveying 
area, which is obtained from the above automatic 
surveying operation. Further, the area, the 

circumferential length, or the like, which relates to the 
5 surveying area can also be calculated by surveying only 
the circumference of the designated surveying area. 

As described above, according to the present 
embodiment, a measurement point which is designated on a 
schematic image can be automatically sighted by a 

10 surveying instrument, so that the measurement point can 
be automatically measured. Further, although it is not 
depicted, when using a surveying instrument with a CCD 
provided inside, the sighting telescope can be more 
precisely sighted to a point by designating the point on 

15 an image captured by the CCD, which has a higher 
magnification than the schematic image, after rough 
sighting to the point. Further, according to the present 
embodiment, the surveying operation within a surveying 
area can be automatically carried out when an operator 

20 merely defines the surveying area on the schematic image, 
so that efficiency of the surveying operation can be 
greatly improved. 

Note that, when using a lens system having a long 
focal length, such as a telephoto lens, distortion which 

25 is a part of the inner orientation parameters is 
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sufficiently small, so that on some occasions it can be 
neglected. Namely/ the inner orientation parameters 
(D 2 , D 4 , D 6 , Ni , N 2 ) can be neglected, so that the remaining 
inner orientation parameters are reduced to (f ,X c ,Yc) . 
5 In this case, only five control points Pi which are 
three-dimensionally arranged are required for obtaining 
the inner orientation parameters <f,X c ,Y c ). Further, 
when the displacement of the principal point from the 
image center, the unsymmetri cal components of the 

10 distortion, and the fourth and sixth distortion 
components are negligible, the remaining inner 
orientation parameters are reduced to (f,D 2 ), so that the 
number of control points required for obtaining the inner 
parameters is reduced to four. As described above, since 

15 the number of unknown inner orientation parameters is 
reduced, the number of control points is also reduced, so 
that labor and time for the surveying can be reduced. 

In the present embodiment, the digital still 
camera 20 is arbitrarily disposed with respect to the 

20 surveying instrument 10, however, the digital still 
camera 20 may be disposed at the position which is 
optically equivalent to the sighting telescope 17 of the 
surveying instrument 10, by using a camera mounting 
accessory equipped on the surveying instrument 10. In 

25 this case, the number of unknown exterior orientation 
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parameters can be reduced, so that the number of control 
points can be reduced. Further, when a schematic image 
is captured with the digital still camera 20 placed at 
the position which is optically equivalent to the 
5 sighting telescope 17 of the surveying instrument 10 
(when the center of projection for an imaging optical 
system of an imaging device is placed at a position that 
is optically equivalent to the sighting origin of a 
sighting telescope) , the horizontal angle and the 

10 vertical angle can be directly calculated from image 
coordinates, so that the process is facilitated. 

In the following, an alternate embodiment when 
the digital still camera 20 is positioned at a point 
where it is optically equivalent to the sighting 

15 telescope 17 is explained with reference to Fig. 12. In 
this case, X 0 , Y 0 , and Z 0 are all equal to zero 
(Xo=Yo=Z o =0) for the exterior orientation parameters 
(X 0 , Y 0 , Z 0 , co , (|> , k) . When the y-axis and the Z-axis of the 
camera coordinate system are defined as to correspond to 

20 the horizontal axis Lh and the vertical Lp of the 
surveying instrument, respectively, the surveying 
coordinate system and the camera coordinate system can be 
regarded as having the same coordinate system. 
Therefore, when the surveying instrument 10 is sighted 

25 onto a measurement point P n on the schematic image (see 
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Fig. 6), the image coordinates (xp n f ,YPn' ) of the image 
point P n T for the measurement point P n can be directly 
obtained from the horizontal angle 9h n and the vertical 
angle 9p n of the surveying instrument 10 sighted onto the 
5 measurement point P n/ and principal distance f of the 
imaging lens by substituting them into the following 
equations : 

x pn T =f tan (0h n -9h o ) /Px+W/2 , 

Y P n'=f tan (Gpn-Opo) /Py+W/2 (9) 
10 where 9h 0 and 9p 0 are initial sighting directions when 
the schematic image is captured (note that, when 
distortion compensation is necessary, the inner 
orientation parameters are also used). Therefore, when a 
sighting position (xpn 1 /Ypn 1 ) is designated on the 
15 schematic image, the horizontal angle 9h n and the 
altitude 9p n of the measurement point P n can be 
calculated as the inverse of Eq. (9) that is: 
9h n =tan" 1 (Px(xp n , -W/2)/f)+ 0h o 

9 Pn =tan- 1 (Py(yPn , -H/2)/f)+ 9 Po . (10) 
20 Therefore, the surveying instrument can be sighted in the 
direction represented by Eq. (10) . 

Fig, 12 is a flowchart of the surveying operation 
for the present alternate embodiment. 

In Step S601, correspondence between the 
25 schematic image and the surveying coordinates is 
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establish based on the single photograph orientation 
process described in Fig. 2. In Step S602 , a measurement 
point P n is designated on the schematic image as a 
sighting point by using the mouse 43 (see Fig. 6) . 
5 Further, a sighting mark is indicated on the designated 
point to indicate the sighting position. In Step S603, 
the sighting angels (9h n , 6p n ) are calculated by 
substituting the position P n ? (x pn ! rYpn') on the schematic 
image for the designated sighting point (measurement 

10 point P n ) into Eq. (10). Further, the surveying 

instrument is oriented in the above direction. In Step 
S604, the indication (color, shape, or size) of the 
sighting point that has already been sighted is changed 
and displayed on the schematic image. By this, this 

15 surveying operation ends. 

According to the present alternate embodiment, an 

operator can visually recognize whether the sighting is 

i 

finished on the schematic image, so that the efficiency 
of the sighting is improved. 

20 Further, another alternate embodiment is 

described, wherein a surveying operation is carried out 
for a sighting point which has three-dimensional position 
information, such as when a measurement point to be 
sighted is given three-dimensional positional information 

25 as planning values, such as a staking point, or when 
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sighting a measurement point has already been measured in 
a previous surveying. When three-dimensional information 
of a measurement point P n is given, the surveying 
instrument 10 can be automatically sighted by calculating 
5 the horizontal angle 8h n and vertical angle 0p n by 
substituting the coordinates (X n/ Y n ,Z n ) of the 
measurement point P n into R± (X Ri , Y Ri , Z R1 ) of Eq. (7) and 
Eq. (8). Fig. 13 shows a flowchart of the surveying 
operation in this case. 

10 In Step S701, correspondence between the 

schematic image and the surveying coordinates is 
establish according to the single photograph orientation 
process described in Fig. 2. In Step S702, a measurement 
point (e.g. staking point) of which the three-dimensional 

15 coordinates are known is indicated on the schematic 
image. An operator defines a sighting direction by 

designating a measurement point on the schematic image, 

i 

the point which is to be sighted, by using a pointing 
device, such as the mouse 43, in Step S703. In Step 

20 S704, the three-dimensional coordinates of the 
measurement point P n are substituted into Eq. (7) and Eq. 
(8) , in order to calculate the sighting angles (0h n/ 6pn) 
and to sight the surveying instrument in the direction 
represented by the above sighting angles. In Step S705, 

25 the indication (color, shape, or size) of the measurement 
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point which has already been sighted is altered. By 
this, this surveying operation ends. 

According to the above alternate embodiment, a 
similar effect as that in the previous alternate 
5 embodiment can be obtained. Thus, the completion of the 
sighting can be visually confirmed on the schematic image 
and efficiency of the surveying operation is improved. 
Note that, in Step S703, a mark indicating a selected 
measurement point may be altered when the measurement 

10 point is designated. In the case of surveying a staking 
point and when the planning coordinate system for the 
staking point is not equivalent to the surveying 
coordinate system, the coordinate values of the staking 
point in the planning coordinate system are transformed 

15 to the surveying coordinate system. On the other hand, 
the inverse transformation can also be carried out. 

In the present embodiments, the surveying 
instrument is oriented to the sighting point R± on the 
collinear line LN G that corresponds to an arbitrary 

20 designated pixel, and the image coordinates (XQi^ygi') on 
the schematic image are calculated from the surveying 
coordinates (X Qi , Y Qi , Z Qi ) measured in the above sighting. 
Further, whether the image coordinates (x.q±* rYQi' ) 
coincide with the image coordinates (Xi' ,yi f ) of the 

25 arbitrarily designated pixel is determined. However, 
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this may be determined by whether the surveying 
coordinates (X Qi , Y Qi , Z Qi ) coincide with the surveying 
coordinates (X Ri , Y Ri , Z Ri ) of the sighting point R± . 

Note that, although in the present embodiments, 
5 the control points are arbitrarily designated on the 
schematic image by using a pointing device, it is also 
possible to capture an image of a reference scale of which 
the dimensions are known, or reference marks at arbitrary 
positions within the schematic image, and to calculate the 

10 exterior orientation parameters by regarding them as the 
control points. In this case, the points on the reference 
scale or the reference marks may be designated on the 
schematic image by a pointing device or the like. 
Further, when the reference scale or the reference marks 

15 are applied the control points on the schematic image may 
be automatically detected by means of image processing. 

In the present embodiments, a computer connected 
to a surveying instrument is used, however, the function 
of the computer may be integrated into the surveying 

20 instrument or a digital still camera. Further, although 
in the present embodiments, a digital image is obtained by 
a digital still camera, any type of image capturing 
device, such as a digital video camera and the like, can 
be used as long as it can finally produce a digital image. 

25 Although the embodiments of the present invention 
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have been described herein with reference to the 
accompanying drawings, obviously many modifications and 
changes may be made by those skilled in this art without 
departing from the scope of the invention. 

The present disclosure relates to subject matter 
contained in Japanese Patent Application No. 2002-190599 
(filed on June 28, 2002) which is expressly incorporated 
herein, by reference, in its entirety. 
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